Pandas Profiling Report

Dataset statistics

Number of variables	14
Number of observations	4605985
Missing cells	14001623
Missing cells (%)	21.7%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	527.1 MiB
Average record size in memory	120.0 B

Variable types

Numeric	8
Categorical	6

Alerts

`ID` has a high cardinality: 4605985 distinct values	High cardinality
`date` has a high cardinality: 552 distinct values	High cardinality
`SKU` is highly correlated with `brandId` and 1 other fields	High correlation
`brandId` is highly correlated with `SKU`	High correlation
`lagerUnitQuantity` is highly correlated with `SKU` and 1 other fields	High correlation
`countryOfOrigin` is highly correlated with `lagerUnitQuantity` and 1 other fields	High correlation
`price` is highly correlated with `countryOfOrigin`	High correlation
`SKU` is highly correlated with `lagerUnitQuantity`	High correlation
`brandId` is highly correlated with `lagerUnitQuantity`	High correlation
`lagerUnitQuantity` is highly correlated with `SKU` and 1 other fields	High correlation
`countryOfOrigin` is highly correlated with `price`	High correlation
`price` is highly correlated with `countryOfOrigin`	High correlation
`lagerUnitQuantity` is highly correlated with `countryOfOrigin`	High correlation
`countryOfOrigin` is highly correlated with `lagerUnitQuantity`	High correlation
`Type` is highly correlated with `Group` and 1 other fields	High correlation
`Group` is highly correlated with `Type` and 1 other fields	High correlation
`Category` is highly correlated with `Type` and 1 other fields	High correlation
`SKU` is highly correlated with `Category` and 6 other fields	High correlation
`Category` is highly correlated with `SKU` and 6 other fields	High correlation
`Type` is highly correlated with `SKU` and 6 other fields	High correlation
`brandId` is highly correlated with `SKU` and 6 other fields	High correlation
`lagerUnitQuantity` is highly correlated with `SKU` and 5 other fields	High correlation
`trademark` is highly correlated with `SKU` and 6 other fields	High correlation
`countryOfOrigin` is highly correlated with `SKU` and 5 other fields	High correlation
`Group` is highly correlated with `SKU` and 6 other fields	High correlation
`geoCluster` is highly correlated with `cityId`	High correlation
`cityId` is highly correlated with `geoCluster`	High correlation
`Category` has 484142 (10.5%) missing values	Missing
`Type` has 484142 (10.5%) missing values	Missing
`brandId` has 1990776 (43.2%) missing values	Missing
`trademark` has 1057713 (23.0%) missing values	Missing
`countryOfOrigin` has 2329612 (50.6%) missing values	Missing
`price` has 3827619 (83.1%) missing values	Missing
`sales` has 3827619 (83.1%) missing values	Missing
`ID` is uniformly distributed	Uniform
`ID` has unique values	Unique

Reproduction

Analysis started	2022-04-29 23:48:43.007916
Analysis finished	2022-04-29 23:59:47.544693
Duration	11 minutes and 4.54 seconds
Software version	pandas-profiling v3.1.0
Download configuration	config.json

SKU
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	60
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	367135.311

Minimum	24
Maximum	838137
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	70.3 MiB

Quantile statistics

Minimum	24
5-th percentile	1008
Q1	39465
median	363713
Q3	642700
95-th percentile	819149
Maximum	838137
Range	838113
Interquartile range (IQR)	603235

Descriptive statistics

Standard deviation	300513.5005
Coefficient of variation (CV)	0.8185360861
Kurtosis	-1.600911761
Mean	367135.311
Median Absolute Deviation (MAD)	314263
Skewness	0.1250106079
Sum	1.691019735 × 10¹²
Variance	9.0308364 × 10¹⁰
Monotonicity	Increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
32485	127987	2.8%
32550	115534	2.5%
32546	114501	2.5%
32490	112642	2.4%
819149	106667	2.3%
47330	103272	2.2%
144184	100930	2.2%
736360	100523	2.2%
787133	98721	2.1%
26194	98387	2.1%
Other values (50)	3526821	76.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
24	73388	1.6%
208	84022	1.8%
1008	78041	1.7%
16649	96990	2.1%
20872	84485	1.8%
26194	98387	2.1%
32485	127987	2.8%
32490	112642	2.4%
32546	114501	2.5%
32549	90627	2.0%

Value	Count	Frequency (%)
838137	43229	0.9%
819150	97955	2.1%
819149	106667	2.3%
815381	63361	1.4%
802382	89149	1.9%
787133	98721	2.1%
782787	95316	2.1%
736360	100523	2.2%
736357	80129	1.7%
711838	85436	1.9%

Category
Categorical

HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	39
Distinct (%)	< 0.1%
Missing	484142
Missing (%)	10.5%
Memory size	70.3 MiB

Semi-hard coarse-pored cheese	381556
Avocado	254592
Water, sparkling	235834
Water, still	230848
Water, import, sparkling	206376
Other values (34)	2812637

Length

Max length	58
Median length	21
Mean length	22.94336563
Min length	4

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	Pomegranate
2nd row	Pomegranate
3rd row	Pomegranate
4th row	Pomegranate
5th row	Pomegranate

Common Values

Value	Count	Frequency (%)
Semi-hard coarse-pored cheese	381556	8.3%
Avocado	254592	5.5%
Water, sparkling	235834	5.1%
Water, still	230848	5.0%
Water, import, sparkling	206376	4.5%
Yoghurts	180652	3.9%
Grapefruit	147906	3.2%
Small fancy bread with berry stuff, own production	142335	3.1%
Banana	127987	2.8%
Lemon	115534	2.5%
Other values (29)	2098223	45.6%
(Missing)	484142	10.5%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
production	1003719	7.3%
own	1003719	7.3%
water	766911	5.6%
bread	647997	4.7%
cheese	622851	4.5%
plain	570528	4.2%
sparkling	536063	3.9%
semi-hard	528902	3.9%
in	460838	3.4%
the	460838	3.4%
Other values (49)	7100746	51.8%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

Type
Categorical

HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	38
Distinct (%)	< 0.1%
Missing	484142
Missing (%)	10.5%
Memory size	70.3 MiB

semi-hard cheese — More expensive — National — Available import	436688
Fancy bread — small — sweet	214162
Yoghurt — firm —plain	180652
Bread — plain — wheat	177911
Table water — PET — from 1 to 2 L — Still	168696
Other values (33)	2943734

Length

Max length	63
Median length	28
Mean length	32.80180929
Min length	7

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	Tropical fruit — Pomegranate— Plain
2nd row	Tropical fruit — Pomegranate— Plain
3rd row	Tropical fruit — Pomegranate— Plain
4th row	Tropical fruit — Pomegranate— Plain
5th row	Tropical fruit — Pomegranate— Plain

Common Values

Value	Count	Frequency (%)
semi-hard cheese — More expensive — National — Available import	436688	9.5%
Fancy bread — small — sweet	214162	4.6%
Yoghurt — firm —plain	180652	3.9%
Bread — plain — wheat	177911	3.9%
Table water — PET — from 1 to 2 L — Still	168696	3.7%
Therapeutic-table water — PET — from 1 to 2 L	168507	3.7%
Baguette loaf — plain	158793	3.4%
Tropical fruit — Avocado — Ready to Eat	141950	3.1%
Bread — flavored	140966	3.1%
Therapeutic-table water — Import — PET	128335	2.8%
Other values (28)	2205183	47.9%
(Missing)	484142	10.5%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
—	7426274	27.9%
plain	1171483	4.4%
fruit	1052589	4.0%
bread	825362	3.1%
water	766911	2.9%
import	737013	2.8%
to	721031	2.7%
pet	688870	2.6%
cheese	622851	2.3%
more	592789	2.2%
Other values (64)	12031684	45.2%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

brandId
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	14
Distinct (%)	< 0.1%
Missing	1990776
Missing (%)	43.2%
Infinite	0
Infinite (%)	0.0%
Mean	3663.891803

Minimum	967
Maximum	8314
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	70.3 MiB

Quantile statistics

Minimum	967
5-th percentile	1241
Q1	1330
median	2737
Q3	7358
95-th percentile	8276
Maximum	8314
Range	7347
Interquartile range (IQR)	6028

Descriptive statistics

Standard deviation	2626.027328
Coefficient of variation (CV)	0.7167316802
Kurtosis	-0.8912058651
Mean	3663.891803
Median Absolute Deviation (MAD)	1407
Skewness	0.8785632628
Sum	9581842817
Variance	6896019.525
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=14)

Value	Count	Frequency (%)
2737	792182	17.2%
1241	413215	9.0%
7358	204622	4.4%
1330	201185	4.4%
8276	180652	3.9%
8274	158221	3.4%
1594	95316	2.1%
967	95055	2.1%
7418	92214	2.0%
3784	89149	1.9%
Other values (4)	293398	6.4%
(Missing)	1990776	43.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
967	95055	2.1%
1241	413215	9.0%
1330	201185	4.4%
1594	95316	2.1%
2313	80698	1.8%
2693	84485	1.8%
2724	75479	1.6%
2737	792182	17.2%
3784	89149	1.9%
7358	204622	4.4%

Value	Count	Frequency (%)
8314	52736	1.1%
8276	180652	3.9%
8274	158221	3.4%
7418	92214	2.0%
7358	204622	4.4%
3784	89149	1.9%
2737	792182	17.2%
2724	75479	1.6%
2693	84485	1.8%
2313	80698	1.8%

lagerUnitQuantity
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	20
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	115.6666998

Minimum	0.5
Maximum	550
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	70.3 MiB

Quantile statistics

Minimum	0.5
5-th percentile	1
Q1	1
median	1.5
Q3	300
95-th percentile	400
Maximum	550
Range	549.5
Interquartile range (IQR)	299

Descriptive statistics

Standard deviation	160.2828934
Coefficient of variation (CV)	1.38573067
Kurtosis	-0.7569635804
Mean	115.6666998
Median Absolute Deviation (MAD)	0.5
Skewness	0.9306525846
Sum	532759084.2
Variance	25690.60591
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=20)

Value	Count	Frequency (%)
1	1927060	41.8%
350	575046	12.5%
1.5	359350	7.8%
2	237754	5.2%
400	209846	4.6%
300	208752	4.5%
70	141502	3.1%
250	127826	2.8%
305	95055	2.1%
340	82448	1.8%
Other values (10)	641346	13.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.5	78041	1.7%
0.75	60309	1.3%
1	1927060	41.8%
1.5	359350	7.8%
2	237754	5.2%
6	62152	1.3%
28	75479	1.6%
50	52736	1.1%
70	141502	3.1%
80	67629	1.5%

Value	Count	Frequency (%)
550	43946	1.0%
500	48529	1.1%
400	209846	4.6%
350	575046	12.5%
340	82448	1.8%
305	95055	2.1%
300	208752	4.5%
250	127826	2.8%
200	71827	1.6%
120	80698	1.8%

trademark
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	23
Distinct (%)	< 0.1%
Missing	1057713
Missing (%)	23.0%
Infinite	0
Infinite (%)	0.0%
Mean	6290.387812

Minimum	297
Maximum	15156
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	70.3 MiB

Quantile statistics

Minimum	297
5-th percentile	1037
Q1	1921
median	5070
Q3	9666
95-th percentile	15156
Maximum	15156
Range	14859
Interquartile range (IQR)	7745

Descriptive statistics

Standard deviation	4434.391018
Coefficient of variation (CV)	0.7049471592
Kurtosis	-0.8683282276
Mean	6290.387812
Median Absolute Deviation (MAD)	3897
Skewness	0.4643881015
Sum	2.232000694 × 10¹⁰
Variance	19663823.7
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=23)

Value	Count	Frequency (%)
9666	743919	16.2%
15156	324328	7.0%
6133	204622	4.4%
2781	201185	4.4%
9974	193519	4.2%
1323	190843	4.1%
5070	180652	3.9%
1037	140452	3.0%
4970	138350	3.0%
297	103272	2.2%
Other values (13)	1127130	24.5%
(Missing)	1057713	23.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
297	103272	2.2%
1037	140452	3.0%
1120	95055	2.1%
1173	95316	2.1%
1192	92214	2.0%
1323	190843	4.1%
1835	75479	1.6%
1839	68026	1.5%
1921	80698	1.8%
2781	201185	4.4%

Value	Count	Frequency (%)
15156	324328	7.0%
11960	94577	2.1%
9974	193519	4.2%
9666	743919	16.2%
8802	93949	2.0%
6133	204622	4.4%
5070	180652	3.9%
4970	138350	3.0%
4891	98387	2.1%
4384	84485	1.8%

countryOfOrigin
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	6
Distinct (%)	< 0.1%
Missing	2329612
Missing (%)	50.6%
Infinite	0
Infinite (%)	0.0%
Mean	7.333039884

Minimum	1
Maximum	37
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	70.3 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	14
95-th percentile	33
Maximum	37
Range	36
Interquartile range (IQR)	13

Descriptive statistics

Standard deviation	10.0943899
Coefficient of variation (CV)	1.376562798
Kurtosis	1.641600802
Mean	7.333039884
Median Absolute Deviation (MAD)	0
Skewness	1.606336295
Sum	16692734
Variance	101.8967075
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=6)

Value	Count	Frequency (%)
1	1429345	31.0%
16	296236	6.4%
14	206376	4.5%
6	146685	3.2%
33	140452	3.0%
37	57279	1.2%
(Missing)	2329612	50.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	1429345	31.0%
6	146685	3.2%
14	206376	4.5%
16	296236	6.4%
33	140452	3.0%
37	57279	1.2%

Value	Count	Frequency (%)
37	57279	1.2%
33	140452	3.0%
16	296236	6.4%
14	206376	4.5%
6	146685	3.2%
1	1429345	31.0%

Group
Categorical

HIGH CORRELATION
HIGH CORRELATION

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	70.3 MiB

Bakery	1214676
Tropical fruits	1180576
Yogurts	820971
Mineral water	766911
Cheese	622851

Length

Max length	15
Median length	7
Mean length	9.650583317
Min length	6

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	Tropical fruits
2nd row	Tropical fruits
3rd row	Tropical fruits
4th row	Tropical fruits
5th row	Tropical fruits

Common Values

Value	Count	Frequency (%)
Bakery	1214676	26.4%
Tropical fruits	1180576	25.6%
Yogurts	820971	17.8%
Mineral water	766911	16.7%
Cheese	622851	13.5%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
bakery	1214676	18.5%
fruits	1180576	18.0%
tropical	1180576	18.0%
yogurts	820971	12.5%
water	766911	11.7%
mineral	766911	11.7%
cheese	622851	9.5%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

geoCluster
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	446
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2220.030811

Minimum	92
Maximum	3230
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	70.3 MiB

Quantile statistics

Minimum	92
5-th percentile	1998
Q1	2049
median	2158
Q3	2269
95-th percentile	2735
Maximum	3230
Range	3138
Interquartile range (IQR)	220

Descriptive statistics

Standard deviation	245.9249253
Coefficient of variation (CV)	0.110775456
Kurtosis	6.275564569
Mean	2220.030811
Median Absolute Deviation (MAD)	110
Skewness	0.5653726135
Sum	1.022542861 × 10¹⁰
Variance	60479.06888
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2043	26383	0.6%
2022	26076	0.6%
1935	25763	0.6%
2069	25680	0.6%
2580	25634	0.6%
1998	25391	0.6%
2064	25256	0.5%
2049	25201	0.5%
1991	25131	0.5%
2060	24772	0.5%
Other values (436)	4350698	94.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
92	37	< 0.1%
112	149	< 0.1%
113	2	< 0.1%
117	62	< 0.1%
131	105	< 0.1%
148	1132	< 0.1%
162	12	< 0.1%
189	239	< 0.1%
199	48	< 0.1%
260	203	< 0.1%

Value	Count	Frequency (%)
3230	221	< 0.1%
3209	4332	0.1%
3196	29	< 0.1%
3179	33	< 0.1%
3177	51	< 0.1%
3175	2	< 0.1%
3172	46	< 0.1%
3168	1215	< 0.1%
3166	13	< 0.1%
3164	17	< 0.1%

cityId
Categorical

HIGH CORRELATION

Distinct	3
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	70.3 MiB

0	4598463
1	7456
25	66

Length

Max length	2
Median length	1
Mean length	1.000014329
Min length	1

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1
2nd row	1
3rd row	1
4th row	1
5th row	1

Common Values

Value	Count	Frequency (%)
0	4598463	99.8%
1	7456	0.2%
25	66	< 0.1%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
0	4598463	99.8%
1	7456	0.2%
25	66	< 0.1%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

ID
Categorical

HIGH CARDINALITY
UNIFORM
UNIQUE

Distinct	4605985
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Memory size	70.3 MiB

RR34354985	1
RR54855593	1
RR44792073	1
RR34027726	1
RR42724877	1
Other values (4605980)	4605980

Length

Max length	10
Median length	10
Mean length	10
Min length	10

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	4605985 ?
Unique (%)	100.0%

Sample

1st row	RR27958444
2nd row	RR27958445
3rd row	RR27958446
4th row	RR27958447
5th row	RR27958448

Common Values

Value	Count	Frequency (%)
RR34354985	1	< 0.1%
RR54855593	1	< 0.1%
RR44792073	1	< 0.1%
RR34027726	1	< 0.1%
RR42724877	1	< 0.1%
RR46125685	1	< 0.1%
RR29087373	1	< 0.1%
RR52608169	1	< 0.1%
RR51017088	1	< 0.1%
RR52497504	1	< 0.1%
Other values (4605975)	4605975	> 99.9%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
rr52245514	1	< 0.1%
rr28239098	1	< 0.1%
rr29047979	1	< 0.1%
rr34228419	1	< 0.1%
rr30663627	1	< 0.1%
rr51844155	1	< 0.1%
rr36366175	1	< 0.1%
rr44667992	1	< 0.1%
rr44989915	1	< 0.1%
rr52591939	1	< 0.1%
Other values (4605975)	4605975	> 99.9%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

date
Categorical

HIGH CARDINALITY

Distinct	552
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	70.3 MiB

2021-07-05	14361
2021-07-04	14347
2021-07-03	14336
2021-07-02	14318
2021-07-01	14291
Other values (547)	4534332

Length

Max length	10
Median length	10
Mean length	10
Min length	10

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	2021-03-03
2nd row	2021-03-04
3rd row	2021-03-05
4th row	2021-03-06
5th row	2021-03-07

Common Values

Value	Count	Frequency (%)
2021-07-05	14361	0.3%
2021-07-04	14347	0.3%
2021-07-03	14336	0.3%
2021-07-02	14318	0.3%
2021-07-01	14291	0.3%
2021-06-30	14260	0.3%
2021-06-29	14227	0.3%
2021-06-28	14205	0.3%
2021-06-27	14192	0.3%
2021-06-26	14180	0.3%
Other values (542)	4463268	96.9%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
2021-07-05	14361	0.3%
2021-07-04	14347	0.3%
2021-07-03	14336	0.3%
2021-07-02	14318	0.3%
2021-07-01	14291	0.3%
2021-06-30	14260	0.3%
2021-06-29	14227	0.3%
2021-06-28	14205	0.3%
2021-06-27	14192	0.3%
2021-06-26	14180	0.3%
Other values (542)	4463268	96.9%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

price
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	1967
Distinct (%)	0.3%
Missing	3827619
Missing (%)	83.1%
Infinite	0
Infinite (%)	0.0%
Mean	67.4906662

Minimum	0
Maximum	7246.89
Zeros	655
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	70.3 MiB

Quantile statistics

Minimum	0
5-th percentile	15.69
Q1	24.19
median	38.49
Q3	61.89
95-th percentile	282.69
Maximum	7246.89
Range	7246.89
Interquartile range (IQR)	37.7

Descriptive statistics

Standard deviation	85.63161109
Coefficient of variation (CV)	1.268791907
Kurtosis	100.9603377
Mean	67.4906662
Median Absolute Deviation (MAD)	17.4
Skewness	3.835564146
Sum	52532439.89
Variance	7332.772818
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
28.49	30740	0.7%
38.39	18033	0.4%
36.99	16637	0.4%
17.09	15681	0.3%
42.69	15442	0.3%
27.09	14784	0.3%
19.99	14006	0.3%
18.79	13968	0.3%
35.59	13946	0.3%
424.69	12444	0.3%
Other values (1957)	612685	13.3%
(Missing)	3827619	83.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	655	< 0.1%
0.09	14	< 0.1%
0.19	6	< 0.1%
0.99	1	< 0.1%
1.09	2	< 0.1%
2.79	4	< 0.1%
2.89	1	< 0.1%
3.29	1	< 0.1%
3.69	2	< 0.1%
3.79	4	< 0.1%

Value	Count	Frequency (%)
7246.89	1	< 0.1%
6049.29	1	< 0.1%
1817.69	1	< 0.1%
1675.69	1	< 0.1%
1585.79	1	< 0.1%
1060.39	1	< 0.1%
908.89	1	< 0.1%
639.09	1	< 0.1%
511.29	1	< 0.1%
482.89	1	< 0.1%

sales
Real number (ℝ_≥0)

MISSING

Distinct	840
Distinct (%)	0.1%
Missing	3827619
Missing (%)	83.1%
Infinite	0
Infinite (%)	0.0%
Mean	3.593747787

Minimum	0.001
Maximum	801
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	70.3 MiB

Quantile statistics

Minimum	0.001
5-th percentile	0.4
Q1	1
median	2.5
Q3	4
95-th percentile	10.2
Maximum	801
Range	800.999
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	4.627157516
Coefficient of variation (CV)	1.287557667
Kurtosis	1492.570332
Mean	3.593747787
Median Absolute Deviation (MAD)	1.5
Skewness	15.01689529
Sum	2797251.09
Variance	21.41058667
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2	127192	2.8%
3	107036	2.3%
1	85388	1.9%
4	71411	1.6%
5	42861	0.9%
6	28168	0.6%
0.5	23221	0.5%
0.4	22514	0.5%
0.3	21828	0.5%
7	18382	0.4%
Other values (830)	230365	5.0%
(Missing)	3827619	83.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.001	11	< 0.1%
0.008	1	< 0.1%
0.037	1	< 0.1%
0.07	1	< 0.1%
0.078	1	< 0.1%
0.086	1	< 0.1%
0.091	1	< 0.1%
0.1	3765	0.1%
0.101	3	< 0.1%
0.104	1	< 0.1%

Value	Count	Frequency (%)
801	1	< 0.1%
489	1	< 0.1%
421	1	< 0.1%
309.4	1	< 0.1%
302	1	< 0.1%
243	1	< 0.1%
220.79	1	< 0.1%
217.5	1	< 0.1%
170	1	< 0.1%
158	1	< 0.1%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	SKU	Category	Type	brandId	lagerUnitQuantity	trademark	countryOfOrigin	Group	geoCluster	cityId	ID	date	price	sales
0	24	Pomegranate	Tropical fruit — Pomegranate— Plain	NaN	1.0	NaN	NaN	Tropical fruits	323	1	RR27958444	2021-03-03	79.49	0.4
1	24	Pomegranate	Tropical fruit — Pomegranate— Plain	NaN	1.0	NaN	NaN	Tropical fruits	323	1	RR27958445	2021-03-04	NaN	NaN
2	24	Pomegranate	Tropical fruit — Pomegranate— Plain	NaN	1.0	NaN	NaN	Tropical fruits	323	1	RR27958446	2021-03-05	NaN	NaN
3	24	Pomegranate	Tropical fruit — Pomegranate— Plain	NaN	1.0	NaN	NaN	Tropical fruits	323	1	RR27958447	2021-03-06	NaN	NaN
4	24	Pomegranate	Tropical fruit — Pomegranate— Plain	NaN	1.0	NaN	NaN	Tropical fruits	323	1	RR27958448	2021-03-07	NaN	NaN
5	24	Pomegranate	Tropical fruit — Pomegranate— Plain	NaN	1.0	NaN	NaN	Tropical fruits	323	1	RR27958449	2021-03-08	NaN	NaN
6	24	Pomegranate	Tropical fruit — Pomegranate— Plain	NaN	1.0	NaN	NaN	Tropical fruits	323	1	RR27958450	2021-03-09	NaN	NaN
7	24	Pomegranate	Tropical fruit — Pomegranate— Plain	NaN	1.0	NaN	NaN	Tropical fruits	323	1	RR27958451	2021-03-10	NaN	NaN
8	24	Pomegranate	Tropical fruit — Pomegranate— Plain	NaN	1.0	NaN	NaN	Tropical fruits	323	1	RR27958452	2021-03-11	NaN	NaN
9	24	Pomegranate	Tropical fruit — Pomegranate— Plain	NaN	1.0	NaN	NaN	Tropical fruits	323	1	RR27958453	2021-03-12	NaN	NaN

Last rows

	SKU	Category	Type	brandId	lagerUnitQuantity	trademark	countryOfOrigin	Group	geoCluster	ID	date	price	sales
4605975	838137	Avocado	Tropical fruit — Avocado — Ready to Eat	NaN	1.0	9666.0	NaN	Tropical fruits	3209	RR31318819	2021-07-02	39.79	10.0
4605976	838137	Avocado	Tropical fruit — Avocado — Ready to Eat	NaN	1.0	9666.0	NaN	Tropical fruits	3209	RR31318820	2021-07-03	39.79	7.0
4605977	838137	Avocado	Tropical fruit — Avocado — Ready to Eat	NaN	1.0	9666.0	NaN	Tropical fruits	3209	RR31318821	2021-07-04	39.79	10.0
4605978	838137	Avocado	Tropical fruit — Avocado — Ready to Eat	NaN	1.0	9666.0	NaN	Tropical fruits	3209	RR31318822	2021-07-05	39.79	3.0
4605979	838137	Avocado	Tropical fruit — Avocado — Ready to Eat	NaN	1.0	9666.0	NaN	Tropical fruits	3230	RR31319304	2021-06-30	39.79	4.0
4605980	838137	Avocado	Tropical fruit — Avocado — Ready to Eat	NaN	1.0	9666.0	NaN	Tropical fruits	3230	RR31319305	2021-07-01	39.79	7.0
4605981	838137	Avocado	Tropical fruit — Avocado — Ready to Eat	NaN	1.0	9666.0	NaN	Tropical fruits	3230	RR31319306	2021-07-02	39.79	6.0
4605982	838137	Avocado	Tropical fruit — Avocado — Ready to Eat	NaN	1.0	9666.0	NaN	Tropical fruits	3230	RR31319307	2021-07-03	39.79	21.0
4605983	838137	Avocado	Tropical fruit — Avocado — Ready to Eat	NaN	1.0	9666.0	NaN	Tropical fruits	3230	RR31319308	2021-07-04	39.39	20.0
4605984	838137	Avocado	Tropical fruit — Avocado — Ready to Eat	NaN	1.0	9666.0	NaN	Tropical fruits	3230	RR31319309	2021-07-05	38.69	8.0

Overview

Variables

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Cramér's V (φc)

Phik (φk)

Missing values

Sample

First rows

Last rows